Search for: All records

Abstract Trade-offs between producing costly movements for gathering information (‘explore’) and using previously acquired information to achieve a goal (‘exploit’) arise in a wide variety of problems, including foraging, reinforcement learning and sensorimotor control. Determining the optimal balance between exploration and exploitation is computationally intractable, necessitating heuristic solutions. Here we show that the electric fishEigenmannia virescensuses a salience-dependent mode-switching strategy to solve the explore–exploit conflict during a refuge-tracking task in which the same category of movement (fore-aft swimming) is used for both gathering information and achieving task goals. The fish produced distinctive non-Gaussian distributions of movement velocities characterized by sharp peaks for slower, task-oriented ‘exploit’ movements and broad shoulders for faster ‘explore’ movements. The measures of non-normality increased with increased sensory salience, corresponding to a decrease in the prevalence of fast explore movements. We found the same sensory salience-dependent mode-switching behaviour across ten phylogenetically diverse organisms, from amoebae to humans, performing tasks such as postural balance and target tracking. We propose a state-uncertainty-based mode-switching heuristic that reproduces the distinctive velocity distribution, rationalizes modulation by sensory salience and outperforms the classic persistent excitation approach while using less energy. This mode-switching heuristic provides insights into purposeful exploratory behaviours in organisms, as well as a framework for more efficient state estimation and control of robots. 

Abstract Controlling the deformation of a soft body has potential applications in fields requiring precise control over the shape of the body. Areas such as medical robotics can use the shape control of soft robots to repair aneurysms in humans, deliver medicines within the body, among other applications. However, given known external loading, it is usually not possible to deform a soft body into arbitrary shapes if it is fabricated using only a single material. In this work, we propose a new physics-based method for the computational design of soft hyperelastic bodies to address this problem. The method takes as input an undeformed shape of a body, a specified external load, and a user desired final shape. It then solves an inverse problem in design using nonlinear optimization subject to physics constraints. The nonlinear program is solved using a gradient-based interior-point method. Analytical gradients are computed for efficiency. The method outputs fields of material properties which can be used to fabricate a soft body. A body fabricated to match this material field is expected to deform into a user-desired shape, given the same external loading input. Two regularizers are used to ascribea prioricharacteristics of smoothness and contrast, respectively, to the spatial distribution of material fields. The performance of the method is tested on three example cases in silico.